Handheld digital camera device with motion sensing and decoding capabilities

ABSTRACT

A handheld digital camera device including: an image sensor for capturing images and generating image data; a two-dimensional motion sensor for generating motion data; and an integral processor configured for: controlling operation of the image sensor; estimating an angular velocity of the camera device relative to an external environment using the motion data; decoding an imaged coding pattern printed on a substrate; and performing an action in the handheld electronic device based on the decoded coding pattern.

CROSS REFERENCES TO RELATED APPLICATIONS

The present application is a continuation of U.S. application Ser. No.13/021,780 filed on Feb. 6, 2011, which is a continuation of U.S.application Ser. No. 12/642,831 filed Dec. 20, 2009, issued Mar. 15,2011 as U.S. Pat. No. 7,907,178, which is a continuation of U.S.application Ser. No. 11/499,806 filed Aug. 7, 2006, issued Jan. 12, 2010as U.S. Pat. No. 7,646,403, which is a continuation of U.S. applicationSer. No. 09/113,090 filed on Jul. 10, 1998, issued Sep. 19, 2006 as U.S.Pat. No. 7,110,024. Each of the above identified patents andapplications is hereby incorporated herein by reference in its entirety.

FIELD OF THE INVENTION

The present invention relates to digital image processing and inparticular discloses A Camera System Having Motion Deblurring Means.Further the present invention relates to the field of digital imagecameras and in particular discloses a camera system having motion blurcompensating means.

BACKGROUND OF THE INVENTION

Motion blur in the taking of images is a common significant problem. Themotion blur normally occurs as a result of movement of the camera whiletaking the picture or otherwise as a result of movement of objectswithin an image. As a result of motion blur, it is often the case thatthe image taken is non optimal.

SUMMARY OF THE INVENTION

According to an aspect of the present disclosure, a camera system foroutputting deblurred still images comprises a portable handheld cameradevice comprising an image sensor for recording an image; atwo-dimensional accelerometer for detecting an angular velocity of thecamera system relative to an external environment and to produce anangular velocity output indicative thereof; a linear image sensor forsensing data provided on an encoded card inserted into the camerasystem, the encoded card containing instructions for the manipulation ofthe image; and a processor for receiving the image from the imagesensor, receiving the angular velocity output from the two-dimensionalaccelerometer, and processing the image in accordance with theinstructions sensed from the encoded to deblur any blurred pixelspresent in the image in consideration of the angular velocity output.

BRIEF DESCRIPTION OF THE DRAWINGS

Notwithstanding any other forms which may fall within the scope of thepresent invention, preferred forms of the invention will now bedescribed, by way of example only, with reference to the accompanyingdrawing in which:

FIG. 1 illustrates a schematic implementation of the preferredembodiment; and

FIG. 2 is a schematic block diagram of the main Artcam electroniccomponents.

DETAILED DESCRIPTION

FIG. 2 illustrates a linear image sensor 34 for incorporation in acamera system. The linear image sensor converts Artcard data images toelectrical signals, which are communicated to the ACP. The linear imagesensor 34 is fabricated using either CCD or APS CMOS technology. Theactive length of the linear image sensor is 50 mm, equal to the width ofthe data array on the Artcard.

To satisfy Nyquist's sampling theorem, the resolution of the linearimage sensor is at least twice the highest spatial frequency of theArtcard optical image reaching the linear image sensor. In practice,data detection is easier if the linear image sensor resolution issubstantially above this. A resolution of 4800 dpi (189 dpmm) is chosen,giving a total of 9,450 pixels. This resolution requires a pixel sensorpitch of 5.3 [mu]m. This can readily be achieved by using four staggeredrows of 20 [mu]m pixel sensors.

The linear image sensor is mounted in a special package which includesan LED to illuminate the Artcard via a light-pipe.

The Artcard reader light-pipe can be a molded light-pipe which hasseveral functions:

1. It diffuses the light from the LED over the width of the card usingtotal internal reflection facets.

2. It focuses the light onto a 16 μm wide strip of the Artcard using anintegrated cylindrical lens.

3. It focuses light reflected from the Artcard onto the linear imagesensor pixels using a molded array of microlenses.

The preferred embodiment is preferably implemented through suitableprogramming of a hand held camera device such as that described inAustralian Provisional Patent Application No. P07991 filed 15 Jul. 1997entitled “Image Processing Method and Apparatus (ART01)”, in addition toAustralian Provisional Patent Application entitled “Image ProcessingMethod and Apparatus (ART01a)” filed concurrently herewith by thepresent applicant, the content of which is hereby specificallyincorporated by cross reference.

The aforementioned patent specifications disclose a camera system,hereinafter known as an “Artcam” type camera, wherein sensed images canbe directly printed out by an internal Artcam portable camera unit.Further, the aforementioned specification discloses means and methodsfor performing various manipulations on images captured by the camerasensing device leading to the production of various effects in anyoutput image. The manipulations are disclosed to be highly flexible innature and can be implemented through the insertion into the Artcam ofcards having encoded thereon various instructions for the manipulationof images, the cards hereinafter being known as “Artcards”. The Artcamfurther has significant onboard processing power by an Artcam CentralProcessor unit (ACP) which is interconnected to a memory device for thestorage of important data and images.

In the preferred embodiment, the Artcam device includes a twodimensional motion sensor. The motion sensor comprises a smallmicro-electro mechanical system (MEMS) device or other suitable deviceable to detect motion in two axes. The motion sensor is preferablymounted on the camera device and its output monitored by the Artcamcentral processor device which is disclosed in the afore-mentionedpatent specifications.

Turning now to FIG. 1, there is illustrated a schematic of the preferredarrangement of the preferred embodiment. The accelerometer 1 outputs tothe Artcard processor 2 which also receives the blurred sensed imagefrom the CCD device. The Artcard processor 2 utilises the accelerometerreadings so as to determine a likely angular velocity of the camera whenthe picture was taken. This velocity factor is then utilised by asuitably programmed Artcard processor 2 to apply a deblurring functionto the blurred sensed image 3 thereby outputting a deblurred outputimage 4. The programming of the Artcard processor 2 so as to perform thedeblurring can utilise standard algorithms known to those skilled in theart of computer programming and digital image restoration. For example,reference is made to the “Selected Papers on Digital Image Restoration”,M. Ibrahim Sezan, Editor, SPIE Milestone series, volume 74, and inparticular the reprinted paper at pages 167-175 thereof. Further,simplified techniques are shown in the “Image Processing Handbook”,second edition, by John C. Russ, published by CRC Press at pages 336-341thereof.

It would be therefore obvious to the person skilled in the art that manydifferent techniques for motion blur removal can be utilised in thepreferred embodiment. Additionally, other forms of motion sensors may beprovided. Once the input image has been deblurred, the image is thenable to be printed out by the Artcam device in accordance with thetechniques as discussed in the afore-mentioned patent specification.

It would be appreciated by a person skilled in the art that numerousvariations and/or modifications may be made to the present invention asshown in the specific embodiment without departing from the spirit orscope of the invention as broadly described. The present embodiment is,therefore, to be considered in all respects to be illustrative and notrestrictive.

1. A handheld digital camera device comprising: at least one imagesensor for capturing images and generating image data; a two-dimensionalmotion sensor for generating motion data; an integral processorconfigured for: controlling operation of the image sensor; estimating anangular velocity of the camera device relative to an externalenvironment using the motion data; decoding an imaged coding patternprinted on a substrate; and performing an action in said handheldelectronic device based on the decoded coding pattern.
 2. The handhelddigital camera device of claim 1 comprising first and second imagesensors.
 3. The handheld digital camera device of claim 1, wherein saidimage sensor is a CCD image sensor or CMOS image sensor.
 4. The handhelddigital camera device of claim 1, wherein the motion sensor is anaccelerometer.
 5. The handheld digital camera device of claim 1, whereinsaid processor is further configured for de-blurring image data usingthe estimated angular velocity.